Deterministic walks in random media: evidence of generic scale invariance 
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Deterministic walks over a random set of points in one and two dimensions (d = 1,2) are consid- 
ered. Points ("cities") are randomly scattered in R'' following a uniform distribution. A walker (a 
"tourist"), at each time step, goes to the nearest neighbor city that has not been visited in the past 
T steps. Each initial city leads to a trajectory composed of a transient part and a final p-cycle at- 
tractor. The distribution of transient times, p-cycles and number of cities per attractor are studied. 
It is shown numerically that transient times (for d — 1,2) follow a Poisson law with a r dependent 
decay but the density of p-cycles follows a power law D{p) oc p~"'^' for d — 2. For large r, the 
expoent tends to a ft; 5/2. Some analytical results are given for the d = 1 case. Since the power law 
is robust and does not depend on free parameters, this system presents "generic scale invariance". 
Applications to animal exploratory behavior and other local minimization problems are suggested. 
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The study of random walks has been very fruitful in 
physics and mathematics, and the theory of such stochas- 
tic processes is a well developed subject. The study 
of deterministic walks is also an interesting subject but 
presents the analytical difSculties common to the area of 
non-linear dynamical systems and has been less investi- 
gated [0 . Here we propose a simple and intriguing prob- 
lem, a deterministic walk over a random graph with N 
nodes that is also an example of a local ( "on-line" ) opti- 
mization dynamics. It may be called the "local traveling 
salesman problem" or perhaps the "tourist problem" for 
short. The deterministic dynamics produces a division of 
the system phase space in several 0{N) attractor basins 
which trap the walker (ergodicity is broken). The prob- 
lem is reminiscent of walks in rugged landscapes but the 
equivalent of "local minima" are cycles instead of point 
attractors. 

The model is defined as follows: points are randomly 
distributed with a uniform density p in R'', where d is 
the dimensionality of the space. These points may be 
thought as "cities" or "safe places" and they may be 
viewed as vertices of a random graph. At each time step, 
the "tourist" follows the deterministic rule: Go to the 
nearest city (or place) that has not been visited in 
the past T time steps. Notice that the tourist wants 
to minimize only the distance to the next city (a local 
optimization procedure), not the sum of all distances in 
the trajectory or some other global cost function. 

Our model can be of general interest for optimization 
theory with local constraints, and studies of deterministic 
dynamical systems with quenched disorder. However, we 
would like to suggest some specific motivations for consid- 
ering this class of problems. The local optimization pro- 
cedure could be naturally related to exploratory, forag- 
ing or migratory behaviors of animals. For example, ro- 
dents present two competing drives: an exploratory drive 
("curiosity") and a defensive behavior called thigmotaxis. 



The later refers to rodent aversion to open spaces and 
preference for places where its whiskers can touch verti- 
cal surfaces or objects, which provide protection |Q. It 
is arguable that, for biological agents (and biologically 
inspired robots) it could be sometimes more important 
to minimize the distance traveled in each movement be- 
tween two safe places instead of to optimize some global 
cost function. In another scale, the model could describe 
migratory or nomadic behaviors of humans, elephants, 
flamingos and other animals with well developed spatial 
memory. Cycles could be related to stable migratory 
routes on environments with localized resources, for ex- 
ample, oceanic islands, oasis and water holes. Local pro- 
cedures are also usual in optimal foraging theory |^ . The 
need for local optimization emerges due to short range 
sensorial capacities. Long distances may also imply non- 
additive costs: animals (and tourists) need safe places to 
stay during night, which puts a maximal distance that 
can be traveled at each time step. 

Starting from a random city, the tourist performs a 
trajectory composed of a transient part and a final p- 
cycle attractor. In this letter we report the statistics 
for some relevant quantities similar to those measured 
in Kauffman networks Q: a) the probability Prit) for 
obtaining a transient of size t, defined as the number of 
steps before the walker enters in some attractor (irre- 
spective to the cycle period); for large t, it is Poisson-like 
PtH) oc exp(— t/f(T)) with the decay time ^(r) growing 
exponentially for d — I and linearly for d = 2; b) the to- 
tal density of attractors I'(t), which decays exponentially 
for d = 1 and as t^^ for d — 2; c) for d — 2, the density of 
p-cycles Dr{p) which follows a power law Dr{p) oc 
for T > 0, with a ~ 5/2 for large r (generic scale invari- 
ance); and d) the average number {nr{p)) of cities present 
in a p-cycle. Also some analytical results are obtained for 
the d = 1 case. 

The discrete time step is simply a label: it does not 
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measure the actual physical time spent when the walker 
travels between the points. This independence makes 
irrelevant the density p of cities because only relative 
distances are important (which city is the nearest) and 
not absolute distances, contrasting to standard random 
walks where the mean length step defines an intrinsic 
length scale. The only parameter is the memory window 
T. Self-avoidance is limited to this window and trajecto- 
ries can intersect outside this range. If r = (no mem- 
ory) the tourist goes simply to the nearest city until it 
finds two cities that are reciprocally nearest neighbors, 
entering in a 2-cycle. In this simple case, attractors may 
be identified with geometrical (cluster) properties. For 
T = N — 1 the trajectory is totally self-avoiding and one 
has a kind of TSP nearest-neighbor algorithm The 
interesting cases are the intermediate ones. For example, 
if T = 1, the last visited city cannot be revisited, and 
only p-cycles with p > 3 can exist. For generic r, the 
relation p> t -\-2 holds. 

In the numerical experiments, N points are randomly 
scattered following a uniform distribution in the inter- 
val [0, 1]''. Each point has d spatial coordinates (x^ — 
x^x^ = y,. . . ,x'^). The cities receive arbitrarily labeled 
as i = 1, . . . , and one constructs the Euclidean distance 
matrix D (for example, Dij = a/ {xi — XjY + [Ui — VjY 
in d = 2). The dynamics can be performed over the 
entries of this matrix instead of on real space. Start- 
ing from some city, one gets a transient trajectory until 
the walker enters some periodic attractor and is trapped. 
The number of steps before the walker enters the cycle 
defines the transient length t. The period p and the num- 
ber of different cities n that pertain to the attractor are 
also determined. The same city can be visited more than 
once, thus n < p. 

A finite size study showed that the behavior of the 
system is smooth as a function of so we have used 
N = 3000 as a reasonable number for our simulations. 
Since each city is used as a starting point, a landscape 
with cities produces TV different transients. The statis- 
tics over Nji realizations of sets of cities ( "landscapes" ) 
are collected. Unless stated otherwise, the results have 
been obtained by using Njj^ = 100. 

A natural question is if there is some critical t that 
produces a phase transition, for example the emergence 
of an untraped (percolating) transient state. The distri- 
bution of transient times does not suggest this possibil- 
ity because it is Poisson, Prit) oc exp(— t/^(r)). This is 
shown for d = 1 in Fig. 1 and for c? = 2 in Fig. 2. The ex- 
ponential decay may be understood as follows. One finds 
numerically that the total number of attractors Na (t) is 
proportional to N, that is, the total density of attractors 
2?(t) = Na/N is constant and depends only on r. These 
attractors are scattered in phase space in a random uni- 
form manner. Like points scattered randomly in space, 
one expects that the distribution of distances between 
attractors follows a Poisson law when these distances are 
larger than the attractor size p. By supposing that tran- 
sient times are proportional to these distances, a Poisson 



law follows also for the transient times. 

For d = 1, the characteristic times grow as ^(r) oc 
exp(7r) (inset Fig. 1) and the total density decays as 
2?(t) oc exp(— 7't) (Fig. 3a). For d — 2, one observes 
the linear dependence ^((r) oc r*, 5 = 1.0 (inset Fig. 2); 
the total density decays as a power law 2?(t) oc t"* 
(Fig. 3b). The average transient is proportional to the 
average distance between attractors, (which are inversely 
proportional to the attractor density). This means that 
2?(r) -^(r) should be constant, that is, 7 = 7' and S — 6'. 
This is indeed the case (see Fig. 3c), but for d = 1, 
although the exponential terms cancel, a linear residue 
remains. A better expression for the ID decay time is 
£_{t) = crexp(7r). We conjecture that the hnear prefac- 
tor arises from the transient time spent in the cities of 
the attractor before it stabilizes (this time is larger for 
d = 1 systems). 

A property of natural interest is the density D^-^p) of 
p-cycles, estimated as the number of different p-cycles 
divided by A^, in the limit of very large systems. Evalu- 
ating this quantity requires careful enumeration because, 
when starting from all the possible initial states, one 
must not count the same attractor twice. Notice that 
'^(t) = J2p^r{p)- For d = 1, Dr{p) is certainly non 
Poisson, although the evidence for a power law is weak 
(Fig. 4a). For d — 2, one observes clear power laws 
Dr{p) oc p""!^"^) (Fig. 4b). The exponent a^r) stabi- 
lizes around a — 5/2 for large r (inset Fig. 4b). Since 
there is no fine tuning of any explicit parameter in our 
system (such as r), the scale invariance is "generic" 
that is, intrinsic to the problem. This is the most sur- 
prising result of our study. We conjecture that this scale 
invariance is related to two factors: a) a uniform distri- 
bution of points has a single length scale, A = p^/'' but 
this length is irrelevant to the dynamics since only rela- 
tive distances are considered when making a move; and 
b) the window r defines a minimal length pmin = t + 2 
but not a maximal one. A clear explanation of this power 
law is still lacking. 

We stress that this problem is not related only to geo- 
metrical properties since the cycles are appear only due 
to the introduced dynamics. Naively, one could think 
that ap-cycle is a geometrical object, for example a clus- 
ter where the distances between the points are smaller 
than any distance outside the cluster. This indeed is 
a sufficient but not necessary condition to obtain a p- 
attractor. For example, for d — 2 (Fig. 5a), a walker 
with memory t — 1 starts from city A and finds the 4- 
cycle ABCD. Although city E is close to the cluster 
(since BE < AB), it is never visited because BC < BE 
and CD < CE. However, if the tourist starts from city 
C, one gets a 3-cycle that includes city El This degen- 
eracy and superposition of attractors can be understood 
observing that Fig. 5 shows trajectories in configuration 
space, not in phase space. In phase space, points cor- 
responds to T + 1-uples (Xt, . . . ,Xt_T-) where Xt is the 
position {x, y) of the tourist at time t and trajectories 
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never intersect. Only for r = the configuration space 
is equivalent to the phase space. 

Finally, we present the average number of cities {nr)(j)) 
pertaining to cycles of period p (Fig. 6). For d — 1 there is 
almost no dispersion in the number of cities per attractor. 
A p-cycle has n{p) cities. We also found that, for n > 
2(t + 2), the following relation holds for even cycles: 

nr{p)=p/2 + T+l. (1) 

To see how this relation emerges, notice that for each 
T there is a minimum cycle of period Pr = r + 2, which 
we call a base block (Fig. 5b). A base block is composed 
of n,- — T + 2 cities. The next cycles follow specific 
constructions (Fig. 5c). But when n is large, geometrical 
constraints impose that the most common p-cycles are 
made of two base blocks (one in each attractor extremity) 
joined by nj intermediate cities, see Fig. 5d. An attractor 
with n cities thus have nj = n~ intermediate points. 
These intermediate cities contribute to the total period 
with pi = 2nj + 2 steps (since for nj — 0, the joining 
of the base blocks contributes with two steps). Thus, 
the total period is p = 2 x Pt + pi = 2{n — t — 1), 
which leads to Eq. (|^). This relation holds for cycles 
with n > 2nr = 2(t + 2), because only these cycles can 
incorporate two independent base blocks. For r = 1, this 
is the unique conceivable manner of constructing cycles, 
meaning that odd cycles are prohibited (and also p = 6 
cycles, see Fig. 4a). For r > 1, it is possible to construct 
odd cycles by using internal loops (an example with t — 2 
is given in Fig. 5e). 

In c? = 2, the attractors are polygons with different 
forms and shapes so that this strict relation between pe- 
riods and cities does not hold, although (n) also scales 
linearly with p (not shown) . For t — I, one finds that odd 
cycles are less probable than even cycles (Fig. 4b) , which 
is reminiscent of the d = 1 behavior. Indeed, this oc- 
curs because elongated odd attractors in two-dimensional 
space are prohibited by the same geometrical constraints 
present in the one-dimensional case. 

Another analytical result for the d = 1 case can be 
obtained. Consider points Xi randomly scattered along 
the real line, defining segments of size Si = Xi — Xi^i. 
Without loss of generality, we assume that p = 1, which 
means that (s) = 1. It is easy to see that the distri- 
bution of interval sizes P{s) follows a Poisson distribu- 
tion P{s) = 6(s)exp(— s), where 6(s) is the Heaviside 
step function. For r = 0, there exist only 2-cycles at- 
tractors, which correspond to pairs of reciprocal nearest 
neighbors. The probability P2 for this configuration is 
equal to the probability that Si-i > Si and s^+i > Si. 
Since Si_i and s^+i are drawn independently, one gets: 

-^2 = I^^dSi P{Si) P{Si^l > Si\Si) P{Si+l > Si\Si) = 

/o°° dsi e""' J^°° ds e*^ — 1/3, that is, on average, one 

third of the sequences of four points leads to reciprocal 
nearest neighbors and so to 2-cycles. Since the number of 
sequences of four points is, in the large N limit, equal to 



the number of points, one obtains Do(2) = 1/3. This has 
been fully confirmed by our numerical simulations (see 
caption Fig. 4). 

The model may be generalized by introducing a 
stochastic component (a "temperature" T = 1//3). For 
example, the probability for the tourist to travel from its 
present city j to some city i may be a function of the dis- 
tance, say, P{j — > i) oc exp{—PDij/\), where A = p^^'^ 
normalizes the distances. In this case we expect, for 
T = 1, a punctuated-equilibrium behavior with 

sporadic transitions between attractor basins. It is an 
open question to determine if there is a critical temper- 
ature Tc where full ergodicity is recovered. 
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FIG. 1. Distribution of transient times Prit) for d = 1. 
From right to left: t = 5, 4, 3, 2 and (squares near the y 
axis). Inset: Decay time ^(t). 

FIG. 2. Distribution Prit) of transient times for d = 2. 
From right to left: t = 10, 5, 3, 2, 1 and 0. Inset: Decay time 



FIG. 3. Total density of attractors ©(r): a) d = 1; b) 
d = 2; c) 2?(t) • 5(t) for d = 1 (squares) and d = 2 (circles), 
error bars smaler than symbol size. 



FIG. 4. Examples of attractor densities T)-r(p): a) d = 1, 
T = 1 (squares) and t = 6 (filled circles); b) d = 2, 
T = 1 (squares) and 10 (filled circles), N = 3000 and 
Nr = 700. Inset: exponent a(r). For r = only 2-cycles ex- 
ist: £)o(2) = 0.333 ±0.001, for d = 1 and L>o(2) = 0.31 ±0.01 
for d = 2. 

FIG. 5. a) Example of superposition of attractors for 
d = 2 and t = 1: starting from A one obtains the 4-cycle 
ABCD, but starting on C one gets the 3-cyclc CBE; b) the 
3-cycle base block for r = 1; c) the 4-cycle for t = 1; d) next 
permissible cycle for r = 1: a 8-cycle made of two base blocks; 
e) example of odd {p = 13) cycle for t = 2 which is possible 
because of an internal loop. 

FIG. 6. Number of cities per attractor (n(p)). a) d = 1, 
r = 1 (filled circles) and r = 5 (circles), theoretical curves 
(solid) n{p) = p/2 + r + 1. 



4 




Fig. 1 - Lima - PRL 




Fig. 2 - Lima - PRL 




Fig. 3 - Lima - PRL 



Fig. 4 - Lima - PRL 



□ • 




10^ 10^ 
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